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ABSTRACT: We assessed impacts on water use achieved by implementation of controlled experiments relating 
to four water conservation strategies in four towns within the Ipswich watershed in Massachusetts. The strate- 
gies included (1) installation of weather-sensitive irrigation controller switches (WSICS) in residences and muni- 
cipal athletic fields; (2) installation of rainwater harvesting systems in residences; (3) two outreach programs: 
(a) free home indoor water use audits and water fixture retrofit kits and (b) rebates for low-water-demand toilets 
and washing machines; and (4) soil amendments to improve soil moisture retention at a municipal athletic field. 
The goals of this study are to summarize the effectiveness of the four water conservation strategies and to intro- 
duce nonparametric statistical methods for evaluating the effectiveness of these conservation strategies in reduc- 
ing water use. It was found that (1) the municipal WSICS significantly reduced water use; (2) residences with 
high irrigation demand were more likely than low water users to experience a substantial demand decrease 
when equipped with the WSICS; (3) rainwater harvesting provided substantial rainwater use, but these volumes 
were small relative to total domestic water use and relative to the natural fluctuations in domestic water use; 
(4) both the audits/retrofit and rebate programs resulted in significant water savings; and (5) a modeling 
approach showed potential water savings from soil amendments in ball fields. 

(KEY TERMS: water conservation; water demand management; water resource planning; nonparametric 
statistics; controlled experiments.) 
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INTRODUCTION ongoing streamflow depletion has raised awareness of 

the importance of water demand management among 
the water authorities, and as a result, the Massachu- 
The Ipswich watershed, situated north of metropol- setts Department of Conservation and Recreation 
itan Boston, MA, has experienced unnaturally low or (MDCR) launched a project, funded by the U.S. Envi- 
no flows during some summer months in recent years ronmental Protection Agency (USEPA), in an attempt 
owing in part, to increases in public water supplies to identify and pilot strategies that could help restore 
(Canfield et al., 1999; Zarriello and Ries, 2000). The instream flows to the Ipswich River. In coordination 
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with four communities in the Ipswich watershed, 
four water conservation projects were designed to 
simultaneously meet immediate municipal needs and 
demonstrate innovative water conservation strategies 
that could be evaluated with real-world data. The 
four projects are (1) installation of weather-sensitive 
irrigation controller switches (WSICS) at residences 
and at municipal athletic fields, (2) installation of 
rainwater harvesting systems at residences, (3) town- 
administered programs to provide (a) home indoor 
water use audits and fixture retrofit kits and 
(b) rebates for low-water-demand toilets and washing 
machines, and (4) soil amendments to improve mois- 
ture retention and reduce water demand at a munici- 
pal athletic field. 

The primary goal of this study is to evaluate the 
effectiveness of four water conservation pilot strate- 
gies on water use. As is inherent to many small-scale 
pilots, the datasets for these demonstration projects 
tend to be small, variable, and exhibit nonnormal dis- 
tributions. A secondary goal of this study is to demon- 
strate the application of mostly nonparametric 
statistical methods for their ability to enable sensible 
inferences to be drawn, in some cases, even from the 
very small samples. 

Vickers (2001) has reviewed approaches relating to 
water conservation strategies for municipal, indus- 
trial, and residential uses. Hilaire et al. (2008) have 
summarized factors impacting the efficiency of water 
use in the urban landscape: water conservation strate- 
gies, landscape design, economic and noneconomic 
incentives, irrigation/water application and reuse 
technologies, and people-plants relationship. Most pre- 
vious research on water conservation strategies 
involves price incentives. Literature on the price elas- 
ticity of water use - impact of water price on water 
demand - is so well developed that meta-analysis is 
now possible (e.g., see the meta-analysis of 64 previous 
studies by Dalhuisen et al., 2003). A review of research 
relating to nonprice water conservation strategies, in 
which price incentives are not used, reveals fewer 
studies. We note three general approaches to non- 
price water conservation research: (1) behavioral 
approaches, (2) retrospective analyses, and (3) con- 
trolled experiments. Examples of the first approach 
are provided by Corral-Verdugo and Frias-Armenta 
(2006) and others who have evaluated the impact of 
social norms (an understanding of the attitudes and 
behavior of others) on water conservation behavior. 
Similarly, Atwood et al. (2007) and others have identi- 
fied the key behavioral, community, and other 
socioeconomic factors that impact water conservation, 
such as gender, environmental attitudes, and neigh- 
borhood features. Gilg and Barr (2006) have provided 
a review of research that summarizes behavioral atti- 
tudes toward water conservation. Most previous 



behavioral research on water conservation consists of 
controlled experimental designs based on a combina- 
tion of surveys and multivariate statistical analyses. 

A second approach to nonprice water conservation 
research involves a retrospective analysis of previous 
water use behavior using available data. For exam- 
ple, Kenney et al. (2004) showed the importance of 
water-use restrictions in reducing water demands 
during a drought experienced by eight Colorado cit- 
ies. Most retrospective research on nonprice water 
conservation strategies has developed multivariate 
relationships for predicting residential water demand 
as a function of conservation efforts in addition to 
numerous other factors or explanatory variables. For 
example, some of the combinations of explanatory 
variables considered for predicting water demand, in 
addition to conservation efforts, include price, house- 
hold appliances, landscape features, metering, and 
climate (Bamezai, 1995); price, weather, and demo- 
graphic characteristics (Kenney et al., 2008); price 
and public information (Wang et al., 1999; Smith and 
Wang, 2008); price, weather, household income, 
municipalities, public information, and education 
(Michelsen et al., 1999); price, public information, 
weather, household characteristics, water use restric- 
tion, and ration (Renwick and Green, 2000); or price, 
public information, weather, household characteris- 
tics, use restriction, ration, and month (Renwick and 
Archibald, 1998). For those cited studies, the demand 
elasticity in response to conservation efforts ranged 
from 0.03 to -4.51 for indoor strategies and 0 
(unresponsive) to -4.81 for outdoor strategies. 

On the other hand, the price elasticity of water 
demand reported in previous research on price 
approaches to water conservation varies. For example, 
Espey et al. (1997) found that price elasticity ranged 
from -0.02 to -0.75 for 75% of price elasticity esti- 
mates, whereas Brookshire et al. (2002) found esti- 
mates ranging from -0.11 to -1.59, and although 
Dalhuisen et al. (2003) concluded that price elasticity 
of water demand is relatively elastic, the authors 
cautioned that price elasticity varied depending on 
functional form selection, aggregation level, data char- 
acteristics, and estimation issues. In conclusion, these 
studies indicate that the effectiveness of both nonprice 
and price approaches varied drastically, thus we are 
unable to judge from previous research whether non- 
price or price approaches are more effective. Moreover, 
Dalhuisen et al. (2003) has concluded that price elas- 
ticity in East United States is insignificant; therefore, 
in the context of our analysis, it is probably safe to 
view economic incentives to be relatively ineffective in 
comparison with other incentives considered here. 

A third approach to nonprice water conservation 
research, and the approach used here, involves 
the use of controlled experiments combined with 
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statistical methods. Here controlled experiments are 
performed with actual water conservation methods. 
For example, Karpiscak et al. (2001) estimated water 
savings by monitoring a water conservation demon- 
stration house. The water savings reported by 
Karpiscak et al. (2001), however, may not be an accu- 
rate response to a single water conservation strategy 
because the synergistic effects associated with multi- 
ple water conservation practices implemented inside 
the demonstration house were not considered. Buch- 
berger and Wells (1996) monitored residential water 
demand at four households over a one-year period 
and used that information to develop stochastic mod- 
els of residential water demands. Although their 
work did not deal directly with water conservation 
efforts, such research could provide important inputs 
to future water conservation strategies. Mayer et al. 
(2003, 2004) and Ayres Associates (1996) have 
employed £-tests to assess water savings due to vari- 
ous water conservation strategies in an experimental 
group relative to a control group. 

There are a few examples of the type of research 
performed here, in which designed experiments are 
used to evaluate the effectiveness of water conserva- 
tion technologies and programs using hypothesis tests 
(Ayres Associates, 1996; Mayer et al., 2003, 2004). 
Those studies employed traditional parametric statis- 
tical methods, and the applicability of the £-test used 
in these studies was not assessed by an investigation 
of probability distributions of the datasets. The 
researchers assumed that the data arose from a nor- 
mal distribution without performing normality 
checks. Here, we are careful to confirm the suitability 
of statistical methods before their application to con- 
trolled experiments to assess the effectiveness of each 
of four independent water conservation strategies. 
We begin by providing an overview of the four conser- 
vation strategies considered and reviewing the statis- 
tical methods employed. 



METHODOLOGIES 



Design of Water Conservation Strategies 

Four water conservation strategies designed to 
reduce water use were implemented in the Ipswich 
River watershed by MDCR, with funding from the 
USEPA. Due to the critical contribution of outdoor 
irrigation to the summertime streamflow deficit (Ips- 
wich River Watershed Action Plan, 2003), these 
water conservation strategies piloted and evaluated 
here have a strong emphasis on reducing lawn and 
athletic field irrigation. The installation of WSICS at 



residences and municipal athletic fields, the installa- 
tion of rainwater harvesting systems, and the intro- 
duction of moisture-retaining soil amendments at an 
athletic field are all strategies designed to mitigate 
water withdrawals for irrigation purposes during the 
summer months. In addition, the home audit/retrofit 
and appliance rebate programs aim to mitigate with- 
drawals for indoor water use, year round. Each case 
study was designed in cooperation with one or more 
municipality in the watershed, based on an opportu- 
nistic assessment of water conservation needs and 
programmatic resources. 

This section, along with Table 1, summarizes the 
water savings hypothesis and evaluation design for 
each of the four demonstration projects. The WSICS 
are designed to only trigger an irrigation cycle when 
the soil moisture is low, as estimated from regional 
weather conditions and local rainfall. By delivering 
water optimally, such technology should reduce over- 
all irrigation demand by eliminating extraneous 
cycles triggered by automatic timers that are insensi- 
tive to weather conditions. The rainwater harvesting 
systems store rainwater, providing a direct alterna- 
tive to the use of public drinking water for nonpo- 
table outdoor uses. We thereby anticipated that the 
systems would reduce demand on household public 
water consumption. The moisture-retaining soil 
amendments were designed to extend the time that 
moisture remains available to the turf roots within 
the soil. As a result, we anticipated that the field 
could tolerate reductions in irrigation volume without 
compromising turf health. The audit/retrofit program 
was anticipated to reduce water use in participating 
households by leading to the direct repair of leaks 
and the replacement of faucets and water fixtures 
with more efficient alternatives. The rebate program 
was anticipated to similarly reduce household water 
use by encouraging the conversion to water-efficient 
toilets and washing machines. 

A summary of evaluation design for all four water 
conservation strategies is documented in Table 1. 
This table includes the sample sizes associated with 
the control and experimental populations, the time 
periods associated with the installation and the 
pre- and postexperiment evaluations, the time 
periods excluded from the analysis, and a list of the 
confounding factors. 

Statistical Methods 

A wide range of statistical methods are considered 
due to the different experimental designs and nature 
of the four water conservation strategies, which were 
designed in accordance with towns' specific needs 
and administrative abilities. Nonparametric statistical 



Journal of the American Water Resources Association 



689 



JAWRA 



Tsai, Cohen, and Vogel 



CO 



S3 
o 



t3 
be 



03 

13 

> 

o 



S3 
CO 



£ 

o 

o 

C8 

g 

S3 
S3 

S3 
O 



u ° 

« "S a 



ph a 



"C 

0) 
0) 



S3 

o 

"H S3 

111 

0 S & 

V S3 



Q 



a 



S3 
O 



S3 

o 



fc: 5 

in " 
S3 ^ 



CD 

CO CO 

o3 tiL 

1 & 

:s § 

1-3 



03 

ft p-j 

d 03 



be 
S3 

"g 



03 ^ 
£ be 

03 ^ 



13 w ^ oj 

& ° 1 S 

to cd aj 

p-< «ih *rt Qj 

2 «J S 8 

S3 co .S3 w 



,0 03 03 
cd 8 _r co S3 

1 II ti 

O o3 x O £ 
CM 



^ b 

^ efc 
CD HH 

CD 

8 2 

CD -H 
© g 

CM 



^ b 



S3 -2 5 



^ CO 

8 ? 



2 S 
o £ 



a % 



ft 

S3 



CM 



S3 



1-1 "S ^ 

^ 6r30 5 

O .H CD 3 

rH CD -P 

+^ CD r-j O 03 

S3 ft O > 

O X jh cl, H 
OH 



t3 „ 

J2 I „ e- 



p£ © 

X3 

CD CD 

S3 O 



2 



CD 
CO 

a g ^ 

"co be o3 

s 9 * 

co S3 32 

O 3 3 

O o3 O 
CM 



V. CD 

^ £ s 

3 be s_, 

5 P CD 

o b* 

03 be o3 

S ® * 

O 



CO 
O 
O 



§ 8 

a - 

03 O 



S3 
o3 
ft 



O +j w 

© S <n 

CM o3 cm 5h 

f+H ft O <^ 



CD ^ CD 

a s a 



p-j OS 



CO 



S3 

CD 

I 

CD 
ft 

XI 



. 

CD ^3 



<N p^ 



^ bp CD 

^ o3 co 

O |J 

S § & 

CO S3 -H 

© S3 g 

O 03 ^ 



CD 

pQ 



.a .a 

CD CO 

O CD 

S3 S3 



is 



13 t5 



S3 CD 
CD +-> 
CD 03 



CD 



03 



o 



03 

g 

"o3 



o s o 

© © 

CD CD CD 

O g O CO 

O £ O s 



O 



CD 



g 2 

^ CD 

2 S 

CM 



CD 
O 
O 
Cxi 



3 



UO 
CD 
CO 



O 
O 

CD 



O O 

O O 

CN 00 

co C<lco 1—1 co 1—1 co 1—1 

a a a a 

cDp3cOp3cOp3i>p3 

O CO rH CM 




CD 03 



JAWRA 



690 



Journal of the American Water Resources Association 



The Impacts of Water Conservation Strategies on Water Use: Four Case Studies 



o 

-+J 

g 

S3 

S3 
o 



'd o 

III 

p a 



o 

•c 

0) 



S3 

o 

-H S3 

03 «H O 
5 0 

* <h S3 

III 



o 

0) 

Q 



GO 



to 



02 

S3 
O 



08 



S3 

O c3 



5 <g - c2 



05 O 

X ^ _h 



^ 3 2 « 



s a 



o CD 
SJ "S 



a a 
a o 

a3 "rt 



a3 ^ 

CD o 

~ ,0 CD 

3 'd ^ 



o 
o 

& £ « 

CO H 4J 



g 



o ^ 

O o 

§ £1 

CD 5h 5 

^ 'd 

g CD S 
> o3 



03 



ft* 2 & 

o -S Sera O 

ft -S -g 5 CD 

ft Cj § M fa 

cd .a ^ 0 ft 



2' 

1 o 
9 ° 



CD 



- X? 
X CD -H 1-3 

•§ *l ^ 

^ D 5 
02 <C 03 



oo u 

jn . . CD 

t3 +-> _d 

P <P k 
03 



X3 'd 

o3 o3 

^ ^ 

U Q CO 



PS 



a 



<tj 



■+j xi 

03 GO 

X o3 



+j 03 X 5h 

^ cd o3 <z| 



CD 5h i-rt 

+3 e o 3 

03 ^ CD 

ll-a 
■a ^ -g 

CD " 

S d g 

& S 
00 a 

O £ CD 



^03 



'd 2 

CD O 

2 ca 



g 2 

^ CD 

o ^ 



fl ft 

o x 




Journal of the American Water Resources Association 



JAWRA 



Tsai, Cohen, and Vogel 



methods are often recommended over parametric 
methods (Helsel and Hirsch, 2002) when sample sizes 
are limited and/or in cases when a probability distri- 
bution cannot be determined for the random variable 
of concern. Here, we used mostly nonparametric 
hypothesis tests, because most of the datasets were 
either too small and/or they violated various assump- 
tions required for parametric hypothesis tests to be 
meaningful. We assumed, throughout our analyses, 
that the type I error probability a was 5%. 

We used nonparametric confidence intervals for 
the true population median because the probability 
distributions of the original random variables could 
not be confirmed for small samples. Such confidence 
intervals for the true population median, shown in 
many subsequent figures, are used to assess whether 
the median estimated from one sample differs from 
the median estimated from another sample. Helsel 
and Hirsch (2002) suggested that the nonparametric 
interval for the median can be estimated using the 
binomial probability distribution. The probability of 
an observation being above or below the median is 
equal so that p = 0.5. For a sample size n, the cumu- 
lative probability p(x) of x observations exceeding the 
median is then 



>(*)=£ 



pl{n-y)l 



0.5 y (l-0.5f- ;y , V*=l,2,...,n. 

(1) 



The lower bound of the interval can be estimated 
using the (x + l)th smallest observation, where x cor- 
responds to p(x) = 0.025, which reflects a 2.5% proba- 
bility in each tail of the distribution of x. The upper 
bound of the interval can be estimated using the 
(n - x)th smallest observation. The resulting confi- 
dence intervals for the median reflect the distribu- 
tions of the estimates of medians drawn from any 
dataset of length n. For cases where the sample sizes 
are large (n > 20), one may use a normal approxima- 
tion to the binomial distribution in Equation (1) lead- 
ing to the rank corresponding to the lower bound of 
the interval estimate of: 



n - Z0.025 x Vn 



for 72>20, 



(2) 



and the upper bound of the interval estimate is the 
R u th smallest observation, where 



R u = 



'0.025 



1 for n>20, 



(3) 



and Z 0 .o25 = 1-96. 

In some instances, we were able to employ hypoth- 
esis tests based on the assumption of a normal distri- 
bution. To check whether observations of a sample 
are normally distributed, the normal probability plot 
correlation coefficient (PPCC) was computed and 
checked against its critical value given in table 18.3.3 
of Stedinger et al. (1993). The normal quantiles were 
estimated using Blom's unbiased, plotting position for 
normal variates (Stedinger et al., 1993): 



Pi 



3/8 



1/4' 



(4) 



where i is the ith observation when ranked in ascend- 
ing order. 

The hypothesis tests used in this study, corre- 
sponding to the various types of comparisons, are doc- 
umented in Table 2. The sign test was chosen over 
the sign rank test and the paired rank-sum test 
because the latter two assume a symmetrical distri- 
bution of the observations and most of our datasets 
are asymmetrical. 



WATER SAVINGS ASSOCIATED WITH WATER 
CONSERVATION STRATEGIES 



The following sections summarize the effectiveness 
at reducing water demand of the four water conserva- 
tion strategies. 



TABLE 2. The Hypothesis Tests Used in This Study Are Presented by Shaded Cells. 



Comparison 
Between 
or Among 



One Sample and Two 
Dependent Samples 



Two Independent Samples 



More Than Two 
Independent 
Samples 



More Than Two 
Dependent Samples 



Nonparametric tests 
Parametric tests 



Sign test 1 ' 2 

^-test 1 ' 2 
Paired ^-test 1 ' 2 



Rank-sum test (or 
Wilcoxon-Mann-Whitney test) 2 
Two-sample ^-test 1 ' 2 



Kruskal-Wallis test 1 ' 2 
One-way ANOVA 1 ' 2 



Appropriate test is 

not available 1 
Two-way ANOVA or 

multi-way ANOVA 1 



x Zar (1999); 2 Helsel and Hirsch (2002). 
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Weather-Sensitive Irrigation Controller Switches 

A total of 11 WSICS were evaluated on residential 
properties and 5 in municipal athletic fields. These 
devices (Weather Reach WR-7® by Irrisoft®, Logan, 
UT, USA) contain an on-site rain gage and receive 
continuous solar radiation, temperature, relative 
humidity, and wind data from a regional weather 
station (town of Ipswich) via wireless transmission. 
Based on this information, the WSICS device is 
designed to deliver water only when needed by the 
landscape. 



Residential WSICS 

Approximately 150 residences in the town of Read- 
ing, MA, have exclusive outdoor water meters. 
Among this group, nine households that met our 
experimental group criteria had WSICS installed dur- 
ing the summer of 2005, and two during the following 
two summers. Criteria included continuous owner- 
ship and use of an automatic irrigation system since 
2001. An additional 71 households with dedicated 
outdoor meters meeting these criteria were selected 
as the control group. For this analysis, quarterly out- 
door water use records were obtained from the Read- 
ing Water Department for all households in the study 
from January 2001 through November 2007. 

For the nine residences whose WSICS was 
installed in 2005, a single value representing historic 
("pre") water use (pre-experimental condition) was 
obtained by averaging the annual outdoor water use 
from 2001 to 2004, and a single value representing 
water use during the experimental period ("post") 
was obtained by averaging the annual outdoor use 
from 2006 to 2007. Data from 2005 were excluded 
from the analysis due to this being a transitional 
year. Because a PPCC normality test determined that 
the control group was not well approximated by a 
normal distribution, the nonparametric rank-sum 
hypothesis test was used to compare the water use of 
both the control and experimental groups as shown 
in Figure 1. There is no statistically significant differ- 
ence between the water use of the control and experi- 
mental groups in either the "pre" or "post" periods, 
which can be seen visually in Figure 1 with the over- 
lapping confidence intervals. However, a visual 
assessment of Figure 1 also suggests that the WSICS 
may have reduced the variability of water use among 
the experimental group, especially among high water 
users. 

Rank-sum tests applied to the rainfall records from 
a nearby water treatment plant suggest that typical 
total rainfall and number of days of rain between 
May 15 and October 15 (the approximate irrigation 
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FIGURE 1. BoxPlots Comparing Annual Outdoor Water 
Use in the Control and Experimental Groups in Both the 
"Pre" (2001 to 2004) and "Post" (2006 to 2007) Periods. 
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FIGURE 2. BoxPlots Showing Water Savings During the "Post" 
Period Relative to the "Pre" Period, in Both Groups. For each 
household, this value represents "post" period water use subtracted 
from "pre" period water use. A value <0 implies more water was 
used during the "post" than "pre" period. 



season) were statistically indistinguishable during 
the "pre" and "post" periods. Thus, we were comfort- 
able calculating "savings" for each household by sub- 
tracting the "post" from the "pre" period water use. 
The results of a rank-sum test do not show that the 
water savings for households with the WSICS were 
different than for the control group. The large range 
associated with the confidence interval (Figure 2) for 
the median of the experimental group is due to the 
small experimental sample size and large variation in 
response to the WSICS installation within the group. 
Nevertheless, Figure 2 illustrates that although the 
average household in the control group saw a drop in 
water demand of 3.27 m 3 /year between the two 
time periods, the average WSICS household saw a 
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FIGURE 3. Comparison of the Annual Outdoor Water 
Savings Between the Control and Experimental Groups 
Among the 90th Percentile of "Pre" Period (2001 to 2004) 
Water Users (annual use >261.6 m 3 ). 

reduction of 40.69 m 3 /year. Although this difference 
is not statistically significant, it reflects the fact that 
households with high "pre" period water demand saw 
a large reduction in water use postinstallation. As 
shown in Figure 3, when only the highest "pre" per- 
iod water users (90th percentile; annual use 
>261.6 m 3 ) are included in the analysis, the water 
savings for the experimental group is significantly 
greater than the control group. These results suggest 
that households with high irrigation water demands 
are more likely to reduce their water use due to the 
WSICS installations. Our analysis also highlights the 
importance of increasing the sample size of the exper- 
imental group of households in any future studies. 



Retrospective Analysis 

A retrospective analysis of the WSICS compared 
actual outdoor water used by each experimental 
household in 2003 and 2004 to the estimated volume 
of water that would have been applied by the WSICS 
during that same period. This analysis required cal- 
culating the number of irrigation cycles that would 
have been triggered for each system, based on: 
(1) weather data from that period, (2) the algorithm 
used by the WSICS units to trigger irrigation cycles 
based on weather data, and (3) each system's individ- 
ual "evapotranspiration (ET) threshold." ET thresh- 
olds are used to set the tolerance for how much 
estimated ET should be allowed before an irrigation 
cycle is triggered to replenish the loss. The number of 
triggered irrigation cycles was then converted to a 
volume for each household by multiplying it by 
the appropriate per-cycle volume. The latter was 
determined at each residence by reading the water 



meter before and after a test irrigation cycle. This 
approach was only applied to 2003 and 2004 to coin- 
cide with the years for which the extensive weather 
data needed in the algorithm was available. A PPCC 
normality hypothesis test suggests that the nonpara- 
metric sign test is preferred over a parametric test 
for assessing the difference between the actual and 
simulated water uses. Although positive overall mean 
and median water savings (22.60 and 29.28 m 3 / 
household/year, respectively) are reported when com- 
paring simulated with actual use, we conclude from 
the nonparametric sign test that the savings is not 
significantly different from zero, owing to the large 
variation in the small sample. When this analysis is 
applied only to water users with high actual water 
use (use >261.6 m 3 ), during the years their use 
exceeded this threshold, the average savings is statis- 
tically significant at 135.8 m 3 /household/year. How- 
ever, this sample consisted only of one year of data 
for each of three households. 

In summary, two approaches were used: (1) com- 
paring outdoor water use in households where 
WSICS were installed to outdoor water use in control 
households, both prior to and after installation; and 
(2) the retrospective analysis, comparing actual water 
use to theoretical water use had the WSICS been 
installed in 2003 and 2004. Both approaches confirm 
that even though overall water savings for the experi- 
mental group is greater than that for the control 
group, the difference in the savings between the two 
groups was not statistically significant owing to the 
highly variable savings in the experimental group. 
WSICS were, however, likely to result in water sav- 
ings when installed at residences with high outdoor 
water demands. Although we did not assess the effi- 
ciency of individual watering regimes prior to WSICS 
installation, the significant response to the systems 
among the highest water users suggests over-water- 
ing by these households prior to the WSICS installa- 
tion, as WSICS systems are designed specifically to 
reduce unnecessary irrigation. 



Municipal WSICS 

In addition to residential WSICS, five municipal 
athletic fields across two municipalities (Reading and 
Middleton, MA) were equipped with WSICS in the 
summer of 2005. A retrospective analysis was con- 
ducted using the same methodology as described 
above for the residential participants. Hypothetical 
water use was derived by simulating irrigation trig- 
gers that would have been signaled by the WSICS, 
had they been installed during 2003 and 2004, using 
weather records from that period and each field's 
WSICS ET thresholds and irrigation cycle volumes. 
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FIGURE 4. Actual Water Use (without WSICS) 
and Simulated Water Use (with WSICS) Aggregated 
for 2003 and 2004 for Each Ball Field. 
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Rainwater Harvesting 

Rainwater harvesting systems are designed to cap- 
ture runoff from rooftops and store the water for non- 
potable uses, such as lawn and garden watering. One 
intent of such systems is to reduce demand on public 
water supplies by replacing potable water that would 
otherwise be used for these outdoor purposes. A total 
of 39 rainwater harvesting systems were installed on 
residential properties mid-April 2006 in the town of 
Wilmington, MA, based on a lottery among 150 inter- 
ested households. The systems consist of a storage 
tank, a pressure pump to aid in water distribution, a 
spigot for a hose, and a water meter to measure flow 
pumped from the tanks. Two different sizes of storage 
tanks were installed: twenty-eight 0.76 m 3 (200-gal- 
lon) and eleven 3.03 m 3 (800-gallon) tanks. Two of 
the participants with 200-gallon tanks upgraded their 
storage capacity to 1.38 m 3 (365 gallons) and 2.27 m 3 
(600 gallons), respectively, using their own funds. 
Except where otherwise noted, the households with 
upgraded systems were excluded from the analyses. 
The rainwater systems were in use during the sum- 
mers of 2006 and 2007. Total rainwater use from the 
time each system was turned on in the spring to 
when it was decommissioned in the fall was recorded 
for each household for 2006 and 2007. The distribu- 
tion of the rainwater use observations for both groups 
is well-approximated by a normal distribution. All 
households used the rainwater systems, and a two- 
sample Student's t hypothesis test on sample means 
indicates that those with 3.03 m 3 tanks used signifi- 
cantly more rainwater than those with 0.76 m 3 tanks 
(Figure 6). 



©: mean 

Narrower box: 95% confidence interval for the medians 



FIGURE 5. Box Plot of Theoretical Water Savings (actual- 
simulated water use) for Each Ball Field, Each Year (2003 
and 2004). Mean per-unit-area savings is 0.11 m 3 /m 2 per 
year (equal to 121,000 gallons/acre/year). 



This simulated use was compared with actual water 
use for each of the five fields aggregated for 2003 and 
2004 (Figure 4). Theoretical water savings were 
obtained by subtracting simulated use from actual 
use for each field for each year. Nonparametric tests 
were used again due to a sample size of 10 (two years 
each, for five fields). The sign test indicates that a 
significant positive water savings would have 
resulted from the WSICS installations. A box plot of 
the theoretical water savings (Figure 5) indicates that 
this statistically significant average savings was 
approximately 0.11 m 3 /m 2 /year (equal to 121,000 
gallons/acre/ye ar ) . 



2 
o 
.c 

0) 
(A 
3 
O 



20 



15 



10- 



5- 



_ _ | 

r 

mJmm 



Tank Capacity 
0.76 m 3 (n=26) 
3.03 m 3 (n=ll) 



0.76 m J 3.03 m J 0.76 m 3 3'. 03 m 3 
(200 gal.) (800 gal.) (200 gal.) (800 gal.) 

2006 2007 



: mean 
: median 



FIGURE 6. The Data and 95% Confidence Intervals for the Mean 

of the Total Rainwater Used From Both Sizes of Harvesting 
Systems During the Summer Watering Seasons of 2006 and 2007. 
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FIGURE 7. Comparison of Scale Between Household 
Domestic Water Use and Rainwater Use. 



FIGURE 8. Rainfall Capture Efficiency in, 2006 and 2007. 

When the sample size n = 1, the interquartile box and 
confidence interval for the median cannot be determined. 



To assess whether the use of rainwater resulted in 
a decrease in domestic water use, domestic water use 
before and after the installation of the rainwater har- 
vesting system was compared for each residential 
participant. The visual comparison of the domestic 
water use and the rainwater use in Figure 7 shows 
that the volumes of rainwater used were generally 
less than the fluctuation in domestic water use from 
year to year, making reductions in domestic water 
use due to rainwater difficult to discern. A rank-sum 
test confirmed that, regardless of the size of the 
tanks, rainwater systems could not be shown to 
impact summer domestic water use. 

However, a written survey completed by all partici- 
pants who attended a meeting at the conclusion of 
the study suggests qualitatively that rainwater was a 
frequent substitute for domestic water among the 
rainwater harvesting participants. The survey asked 
participants to allocate the proportion of the rainwa- 
ter they used across seven usage activities (one cate- 
gory was defined flexibly as "other" to capture 
uncommon uses) and to state for each whether they 
would have used an equivalent or greater amount of 
domestic water for that purpose if they did not have 
access to stored rainwater. All respondents (19 of 37 
households that were in the program; i.e., 50% of par- 
ticipants) estimated that at least some of their rain- 
water uses were direct substitutes for domestic water 
that they otherwise would have used for the same 
purpose. 

Twenty-five households were able to provide esti- 
mates of the roof area contributing to their rainwater 
collection system. For each of these households, the 
total volume of rain falling on the contributing area 
was estimated by multiplying contributing area by 
daily rainfall depth recorded at a nearby facility for 
the days the system was in use. Rainfall capture 



efficiency was defined as the ratio of total volume of 
rainwater used relative to the total volume of rain 
that fell on the contributing roof area. Each house- 
hold has a unique rainfall capture efficiency, based 
on the combined influences of system storage capac- 
ity, frequency of system use, and the pattern (distri- 
bution, intensity, etc.) of rainfall events. A rank-sum 
test of "rainfall capture efficiency" by system size 
(Figure 8) suggests that, in 2007, households with 
800-gallon systems had statistically higher efficien- 
cies than those with 200-gallon systems, whereas in 

2006 the two groups had statistically equivalent effi- 
ciencies. The efficiencies of both groups improved in 

2007 relative to 2006, which might be explained by a 
difference in rainfall patterns between the two years 
or might indicate a learning curve as participants get 
used to system operation. As a final observation, the 
two households with modified systems (365- and 600- 
gallon systems) demonstrated a relatively high rain- 
fall capture efficiency among all the study partici- 
pants. A possible explanation is that the participants 
who took extra care to tailor their systems to their 
specific needs were able to increase their systems' 
efficiency. 

Residential Audit /Retrofit and Water Conservation 
Appliances Rebates 

As part of a town-wide water conservation plan, in 
September of 2003, the town of Reading, MA, began 
offering water customers free indoor water use audits 
and water saving retrofit devices tailor-made to the 
results of the audits. The town also began offering 
customers rebates for eligible water-efficient appli- 
ances (washing machines and toilets) purchased on or 
after July 1, 2003. The purpose of this study was to 
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evaluate the effectiveness of these two programs at 
reducing town-wide water demand and the water 
demand of those households who chose to participate 
in either or both programs. Only winter water use 
data were evaluated to isolate indoor water use and 
eliminate the confounding effect of year-to-year 
weather variability on water use during the irrigation 
season. 

Participating households were grouped into five 
mutually exclusive categories of participation: (1) 
audit/retrofit (AR), (2) audit/retrofit and any type of 
rebate(s) (AR&R), (3) rebate-toilet(s) (RT), (4) rebate- 
washing machines(s) (RW), and (5) rebate-toilet(s) 
and washing machine(s) (RT&W). Participants in the 
same category should not be interpreted to have 
exactly the same level of participation. For example, 
the numbers of low-flush toilets for any two house- 
holds in the group RT may be different, and the num- 
ber of retrofit devices installed among households in 
the group AR is variable. This variability did not hin- 
der analysis, as the intent of the study was not to 
evaluate savings associated with individual technolo- 
gies, but rather savings resulting from the programs 
as a whole, which naturally include varying levels of 
participation. 

Quarterly water use records for the entire town 
were obtained from February 2001 through May 
2007. To isolate indoor water use, only quarters that 
began on or after October 19 and ended on or before 
April 14 of any year were included in the analysis. 
For each household, records dated before the installa- 
tion of a qualifying rebate device or date of audit are 
regarded as "pre" winter use, whereas those recorded 
after are "post" winter use. Savings was determined 
by subtracting the average of the "post" use records 
from the average of the "pre" use records. To control 
for factors other than participation in the water con- 
servation program that might trigger a change in 
water use patterns, households that did not partici- 
pate in any program were included in a control 
group. However, as participating households initiated 
their participation across different years during the 
study window, a single date could not be selected to 
separate "pre" and "post" time periods for the control 
group. Therefore, we analyzed the control group four 
times to coincide with the variable points of initiation 
for the participating households. Specifically, "pre" 
minus "post" water use was calculated for the control 
group using each of the following four pre v. post 
groupings of years: (1) 2001-2002 v. 2003-2007, 
(2) 2001-2003 v. 2004-2007, (3) 2001-2004 v. 2005- 
2007, and (4) 2001-2005 v. 2006-2007. 

The normal PPCC hypothesis test results suggested 
that nonparametric hypothesis tests are preferred. 
Sign tests showed statistically significant winter 
water savings in each conservation program category 
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FIGURE 9. Winter Water Savings Among the Five Different Water 
Conservation Treatment Categories and the Control Group, Ana- 
lyzed Four Ways. Values <0 imply an increase in water use after 
installing a water conservation device or receipt of an audit and 
retrofit kit. The five treatment categories are: audit/retrofit (AR); 
audit/retrofit and any type of rebate(s) (AR&R); rebate-toilet(s) 
(RT); rebate-washing machines(s) (RW); and rebate-toilet(s) and 
washing machine(s) (RT&W). 



except AR&R (Figure 9 and Table 3a). However, the 
AR&R households (those participating in both the 
audit/retrofit and rebate programs) did demonstrate 
the highest median and second-highest average sav- 
ings among the categories. The small sample size of 
this group likely explains our inability to detect a sta- 
tistically significant savings for this category. In con- 
trast to the households participating in the 
conservation programs, the control group households 
showed no statistically significant changes in water 
use for any of the time frames denned. 

To evaluate the effect of the two outreach pro- 
grams on town-wide water use, the overall per-house- 
hold median savings for participating at any level in 
either program was multiplied by the number of par- 
ticipating households (Table 3b). The town saved 
3,950 m 3 /quarter as a result of implementing both 
programs. Town-wide participation rates are shown 
for each program and for those participating in both 
programs (number of participating households/num- 
ber of households in town). Participation rates are an 
important factor in estimating the overall savings 
that another town might be able to achieve by imple- 
menting similar programs. However, it should be 
noted that Reading saw waves of new participation 
each time the town conducted concerted outreach 
efforts during the course of the programs. We can 
assume, then, that the participation rates observed in 
Reading are closely related to the particular level of 
outreach effort exerted by the town, and it follows 
that other towns might be able to increase participa- 
tion rates with more intensive outreach efforts. 
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TABLE 3. (a) Sample Size, Mean and Median Water Savings for Each of the Five Participation Categories, 
(b) Participation Rates and Town-Wide Savings for Audit/Retrofit and Appliance Rebate Programs. 



(a) 






Savings (mVquarter/household) 






AR 


AR&R 


RT 


RW 


RT&W 


N 


99 


32 


87 


527 


30 


Mean water savings 


4.93 


5.01 


3.94 


5.38 


4.58 


Median winter water savings 


3.96 


9.20 


1.89 


5.66 


7.08 



(b) 



N 



Participation Rate 
Based on Number of 
Households in Town (8,436) 



Water Savings 
(m 3 /quarter/ 
households) 



Mean 



Median 



Town-Wide 

Savings 
(mVquarter) 



All levels of participation 775 

AR 99 

AR&R 32 

Combined RT, RW, RT&W 644 



0.092 
0.012 
0.004 
0.076 



5.11 
4.93 
5.01 
5.15 



5.10 
3.96 
9.20 
5.19 



3,950 



TABLE 4. Simulated Irrigation Volumes Applied to Zeolite and Control Fields (2003 to 2007). 



Simulated Volumes in Year (cm 3 /cm 2 /year) 





Threshold (cm) 


2003 


2004 


2005 


2006 


2007 


Mean 


Zeolite field 


0.89 


3.68 


5.11 


8.37 


5.35 


9.30 


6.36 


Control field 


0.64 


9.08 


7.92 


11.62 


7.90 


13.25 


9.95 


Savings (control-zeolite) 




5.40 


2.80 


3.25 


2.56 


3.95 


3.59 


% Savings (savings/control) 




59.52 


35.40 


28.00 


32.35 


29.82 


37.02 



Soil Amendments in Ball Fields 

A portion of an 8-acre municipal athletic field com- 
plex in the town of North Reading, MA, was redevel- 
oped to maximize infiltration and minimize irrigation 
requirements and application of fertilizer and pesti- 
cides by employing the following techniques: (1) soil 
enhancement with zeolite, an additive that retains 
moisture and nutrients; (2) use of drought-resistant 
turf; and (3) installation of a WSICS (see section 
on Weather-Sensitive Irrigation Controller Switches). 
The adjacent field, which has identical solar orienta- 
tion, drainage patterns, and original soil profile, 
received only the latter two treatments and was used 
as a control to evaluate the effectiveness of the zeolite 
additive. 

The field manager progressively adjusted the 
WSICS ET thresholds for each field in order to iden- 
tify the most conservative watering scheme that could 
still maintain healthy turf. These thresholds set the 
tolerance for how much estimated ET is allowed 
before an irrigation cycle is triggered. The optimal 
thresholds of the zeolite and control fields were found 
to be 0.89 cm (0.35 inches) and 0.64 cm (0.25 inches), 
respectively. These settings were used to simulate the 
number of irrigation cycles that the WSICS would 



have applied to each field over the five-year period 
from 2003 to 2007, using historic weather data 
(see Retrospective Analysis under Weather-Sensitive 
Irrigation Controller Switches for methodology). The 
number of cycles was then converted to a total annual 
volume, based on the respective per-cycle volumes 
measured for each field. Savings was denned by sub- 
tracting the total per-acre irrigation volume applied to 
the zeolite field from that applied to the control field, 
for each year. The optimum settings resulted in an 
estimated average annual per-unit-area savings of 
approximately 3.59 cm 3 /cm 2 (38,000 gallons/acre), or 
37% (Table 4). Such substantial savings suggest that 
zeolite soil amendments may prove to be a very effec- 
tive means to reduce irrigation demands of athletic 
fields. However, these results are highly dependent on 
the optimal ET thresholds observed for each field, 
based on trial and error and field observation over the 
course of a few months. To further refine the expected 
savings achievable through zeolite soil amendments, 
optimal watering thresholds could be verified by the 
use of soil moisture sensors. Additionally, obser- 
vations over a longer time period that encompass 
greater variability of weather patterns would help 
verify optimal ET thresholds and refine long-term 
savings estimates. 
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CONCLUSIONS 



The overall goal of this study was to evaluate the 
effectiveness of four water conservation pilot strate- 
gies on water use. As is inherent to many small-scale 
pilots, the datasets for these demonstration projects 
tend to be small, variable, and exhibit nonnormal dis- 
tributions. A secondary goal of this study was to dem- 
onstrate the application of mostly nonparametric 
statistical methods for their ability to enable sensible 
inferences to be drawn, in some cases, even from the 
very small samples. 

Statistical hypothesis tests combined with con- 
trolled water conservation experiments were used to 
evaluate water savings associated with four water 
conservation strategies implemented in communities 
in the Ipswich watershed in Massachusetts, 
designed for their combined ability to meet an 
immediate municipal need and pilot an innovative 
conservation strategy. Our review of the literature 
revealed that controlled water conservation experi- 
ments combined with nonparametric statistical anal- 
yses of the type performed here are not commonly 
reported. Instead, most previous research has 
focused on retrospective statistical analyses of water 
use as well as studies that sought to elucidate 
behavior and attitudes concerning various water 
conservation strategies. Our overall findings for each 
of the four water conservation programs are as 
follows: 

1. Weather-sensitive irrigation controller switches: 
Residential water use patterns were variably 
impacted by the addition of the WSICS, with 
some participants showing a decrease and others 
showing an increase in water use. The WSICS 
appeared to reduce the variability of water use 
among residential participants, most notably by 
causing a reduction in water use of the highest 
historical water users. Our findings underscore 
that initial water use patterns are likely to be a 
prominent factor in determining whether water 
use will increase or decrease after WSICS instal- 
lation in a residential setting. Water users who 
rely on inefficient watering regimes, historically, 
are more likely to benefit from the WSICS, which 
may explain why the participants in our study 
with the highest historical water use showed 
large and statistically significant water savings 
after installing the WSICS. In contrast to the 
residential setting, WSICS installations at muni- 
cipal athletic fields resulted in consistent reduc- 
tions in water application, with an average 
savings of 0.11 m 3 /m 2 /year (121,000 gallons/acre/ 
year). This suggests that, prior to installation of 



WSICS, ball fields in our study were more con- 
sistently overwatered than residential lawns. 
This is not surprising, given that towns gener- 
ally require a high level of turf performance on 
their athletic fields but lack the staff to fre- 
quently adjust irrigation settings in response to 
weather (such as reducing irrigation volumes 
after or in anticipation of rain events). To ensure 
sufficient irrigation without frequent adjust- 
ments, systems are set to water frequently, 
regardless of need. Strict standards for turf per- 
formance and limited staff resources are common 
in municipal settings, suggesting that the sav- 
ings observed at ball fields in this study are 
likely transferable to other ball field sites. 

2. Rainwater harvesting: Rainwater was used for 
outdoor purposes by all participants, and those 
with 3.03 m 3 systems (800 gallons) used signifi- 
cantly more than those with 0.76 m 3 systems 
(200 gallons). Annual volumes of rainwater used 
were small compared with domestic water use, 
and reductions in domestic water use as a result 
of substitution with rainwater could not be dis- 
cerned amidst the background fluctuations in 
domestic water use from year to year. However, 
a participant survey suggested that for every 
household, at least some of the rainwater used 
was a direct substitute for domestic water that 
would have been used for the same purpose. 
Rainfall capture efficiency was measured as the 
ratio of rainwater used relative to the rain that 
fell on the contributing roof area during the 
months of system operation. Efficiency of both 
size systems improved in the program's second 
year, which may indicate different rainfall pat- 
terns between the two years or that there is a 
learning curve as participants got used to system 
operation. In the second year, the larger systems 
were more efficient than the smaller systems, 
whereas they were statistically equivalent the 
first year. A possible explanation is that as rain- 
fall capture efficiency improves, the impact of 
system size becomes more pronounced. Two 
households that modified their systems' size were 
among the most efficient, suggesting that effi- 
ciency may be improved by tailoring one's system 
to one's needs. 

3. Residential audit /retrofit and water conservation 
appliance rebates: Participation in two town- 
administered water conservation programs 
(a. free indoor water use audits and fixture 
retrofit kits; b. low flow toilet and washing 
machine rebates) was divided into five catego- 
ries. Four resulted in modest but significant posi- 
tive water savings averaging between 3.94 and 
5.38 m 3 /quarter/household. Although the fifth 
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participation category (participation in both 
programs) showed no statistically significant 
water savings, this group's median and mean 
savings were ranked the highest and second- 
highest, respectively, among all five categories. 
The finding of nonstatistically significant savings 
of this group appeared to result from the 
small sample size and large variation in water 
savings among the participants. In the first four 
years of program implementation, 9.2% of the 
town's households participated in one or both of 
the programs, resulting in an overall average 
savings of approximately 3,950 m 3 /quarter for 
the town. 

4. Soil amendments in ball field: The addition of a 
moisture and nutrient-retaining additive, zeolite, 
to the soil of a ball field resulted in healthy turf 
with less water applied than to an adjacent con- 
trol field. Based on observed irrigation require- 
ments, the zeolite material was estimated to 
save approximately 3.59 cm 3 /cm 2 /year (38,000 
gallons/acre/year). This represents a reduction 
of 37% in irrigation volume, suggesting promis- 
ing water savings from zeolite soil amendments. 

Future research on all of the above strategies 
could be used to verify or refine the results reported 
here. To address the specific constraints encountered 
in this study, the following approaches are sug- 
gested. WSICS should be evaluated with larger resi- 
dential sample sizes and include an assessment of 
historic irrigation efficiency. Additional size catego- 
ries of rainwater harvesting systems should be eval- 
uated for rainfall capture efficiency under a variety 
of rainfall conditions and further investigation 
should be made into the ability of such systems to 
reduce domestic water use. Town-administered 
water conservation programs such as Reading's 
should continue to be evaluated over longer time 
frames to better understand the long-term potential 
for savings among participating households and at 
the town level. Lastly, turf health on the soil- 
amended and control ball fields was determined by 
visual inspection. Future research should employ a 
more sophisticated method for comparing the turf 
health. 
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